A surrogate-assisted controller for expensive evolutionary reinforcement learning

نویسندگان

چکیده

The integration of Reinforcement Learning (RL) and Evolutionary Algorithms (EAs) aims at simultaneously exploiting the sample efficiency as well diversity robustness two paradigms. Recently, hybrid learning frameworks based on this principle have achieved great success in various challenging robot control tasks. However, these methods, policies from genetic population are evaluated via interactions with real environments, limiting their applicability computationally expensive problems. In work, we propose Surrogate-assisted Controller (SC), a novel efficient module that can be integrated into existing to alleviate computational burden EAs by partially replacing policy evaluation. key challenge applying is prevent optimization process being misled possible false minima introduced surrogate. To address issue, present strategies for SC workflow frameworks. Experiments six continuous tasks OpenAI Gym platform show not only significantly reduce cost fitness evaluations, but also boost performance original collaborative evolutionary processes.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems

Integrating data-driven surrogate models and simulation models of di erent accuracies (or delities) in a single algorithm to address computationally expensive global optimization problems has recently attracted considerable attention. However, handling discrepancies between simulation models with multiple delities in global optimization is a major challenge. To address it, the two major contrib...

متن کامل

Reinforcement Evolutionary Learning for Neuro-Fuzzy Controller Design

In recent years, the concept of the fuzzy logic or artificial neural networks for control problems has grown into a popular research area [1]-[3]. The reason is that classical control theory usually requires a mathematical model for designing controllers. The inaccuracy of mathematical modeling of plants usually degrades the performance of the controllers, especially for nonlinear and complex c...

متن کامل

A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance

Fuzzy logic systems are promising for efficient obstacle avoidance. However, it is difficult to maintain the correctness, consistency, and completeness of a fuzzy rule base constructed and tuned by a human expert. A reinforcement learning method is capable of learning the fuzzy rules automatically. However, it incurs a heavy learning phase and may result in an insufficiently learned rule base d...

متن کامل

Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling

We present a parallel evolutionary optimization algorithm that leverages surrogate models for solving computationally expensive design problems with general constraints, on a limited computational budget. The essential backbone of our framework is an evolutionary algorithm coupled with a feasible sequential quadratic programming solver in the spirit of Lamarckian learning.We employ a trust-regi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Information Sciences

سال: 2022

ISSN: ['0020-0255', '1872-6291']

DOI: https://doi.org/10.1016/j.ins.2022.10.134